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Abstract. In this paper, we focus on the heterogeneity of social networks and its role to the emergence of 
prevailing cooperation and sustaining cooperators. The social networks are representative of the interaction 
relationships between players and their encounters in each round of games. We study an evolutionary 
Prisoner's Dilemma game on a variant of Newman- Watts small-world network, whose heterogeneity can be 
tuned by a parameter. It is found that optimal cooperation level exists at some intermediate topological 
heterogeneity for different temptations to defect. That is, frequency of cooperators peaks at some specific 
values of degree heterogeneity — neither the most heterogeneous case nor the most homogeneous one 
would favor the cooperators. Besides, the average degree of networks and the adopted update rule also 
affect the cooperation level. 

PACS. 02.50.Le Decision theory and game theory - 89. 75. He Networks and genealogical trees - 87.23.Ge 
Dynamics of social systems 

1 Introduction well-mixed population by using mean-field theory of sta- 

tistical physics. In classic game theory, the players are 



Evolutionary game theory has been well developed as an 
interdisciplinary science by researchers from biology, eco- 
nomics, social science, computer science for several decades. 
In past few years, it also gained the interests of physicists 
to study some phenomena and intriguing mechanisms in 



assumed to be completely rational and try to maximize 
their utilities according to opponents' strategies. Under 
these assumptions, in the Prisoner's Dilemma game (PD 
game), two players simultaneously decide whether to co- 
operate (C) or to defect (D). They both receive R upon 
e-mail: f uf eng@pku . edu . cn 

e-mail: longwang@pku.edu.cn mutual cooperation and P upon mutual defection. A de- 
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fector exploiting a C player gets T, and the exploited 
cooperator receives S, such that T > R > P > S and 
2R > T + S. As a result, it is best to defect regardless of 
the co-player's decision. Thus, defection is the evolution- 
arily stable strategy (ESS), even though all individuals 
would be better off if they cooperated. Thereby this cre- 
ates the social dilemma, because when everybody defects, 
the mean population payoff is lower than that when ev- 
erybody cooperates. However, cooperation is ubiquitous in 
natural systems from cellular organisms to mammals. In 
the past two decades, some extensions on PD game have 
been considered to elucidate the underlying mechanisms 
boosting cooperation behaviors by which this dilemma 
could be resolved. For instance, depart from the well- 
mixed population scenario, Nowak and May considered 
PD game on spatially structured population Ij. All indi- 
viduals are constrained to play only with their immediate 
neighbors. They found that spatial structure enhances the 
ability of cooperators to resist invasion by defectors. 

The successful development of network science pro- 
vides a systematic framework for studying the dynam- 
ics processes taking place on complex networks [2 3 . For 
most networks, including the World Wide Web, the Inter- 
net, and the metabolic networks, they have small-world 
property and are demonstrated to be scale- free j4|5l . The 
network theory is a natural and convenient tool to de- 
scribe the population structure on which the evolution 
of cooperation is studied. Each vertex represents an in- 
dividual and the edges denote links between players in 
terms of game dynamical interaction. Trivially, one could 



heterogeneous Newman- Watts small-world network 

conclude that both well-mixed population and spatially- 
structured population are represented by regular graphs. 
It is, however, unrealistic to assume the real world is as 
homogeneous as regular graphs. Furthermore, as afore- 
mentioned, many real-world networks of interactions are 
heterogeneous, namely, different individuals have different 
numbers of average neighbors with whom they interact. 
In 6 , Abramson and Kuperman studied a simple model 
of an evolutionary version of the Prisoner's Dilemma game 
played in small- world networks. They found that defectors 
prevail at some intermediate rewiring probability. By in- 
troducing the volunteering participation, Szabo et al. in- 
vestigated the spatio-temporal diagrams of the evolution- 
ary process within the context of rewired lattices which 
have small- world property J\. Other paradigms of game 
with spatially-structured population or on graphs, such 
as snowdrift game, rock-scissors-paper game, public goods 
game, etc, have been studied |8l9ll0j . 

Recently, Santos and Pachcco discovered that in scale- 
free networks, the cooperators become dominant for entire 
range of parameters in evolutionary PD game and snow- 
drift game [11 . They also demonstrated that the enhance- 
ment of cooperation would be inhibited whenever the cor- 
relations between individuals are decreased or removed. 
Being similar to Hamilton's rule, Ohtsuki et al described a 
simple rule for evolution of cooperation on graphs and so- 
cial networks — the benefit-to-cost ratio exceeds the aver- 
age number of neighbors [T^] . In |13I14| , Santos suggested 
that the heterogeneity of the population structure, espe- 
cially scale-free networks, provides a new mechanism for 
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cooperators to survive. Moreover, cooperators are capable some explanations to the results. Conclusions are made in 

of exploiting the heterogeneity of the network of interac- Sec. IV. 

tions, namely, finally occupy the hubs of the networks. 

Besides, Vukov and Szabo studied the evolutionary PD ■ . 

2 The model 

game on hierarchical lattices and revealed that the high- 
est stationary frequency of cooperators occurs in some in- 2.1 The Heterogeneous ISIewman-Watts (HNW) 

termediate layers [15j. Some researchers have studied mi- model 
nority game [16] , with small- world interactions 17J, with 

We consider one-dimensional lattice of N vertices with pe- 

emergent scale-free leadership structure p2], etc. Howbeit, 

riodic boundary conditions, i.e., on a ring, and join each 

these works are mostly studied on crystalized (static) net- 
vertex to its neighbors k or fewer lattice spacing away. 

works, i.e., the topology of network is not affected by the 

Instead of rewiring a fraction of the edges in the regu- 

dynamics on it. Therefore, adapting the network topol- 

lar lattice as proposed by Watts and Strogatz [Ij, some 

ogy dynamically in response to the dynamic state of the 

"shortcuts" connecting randomly chosen vertex pairs are 

nodes should be taken into account. Evolutionary games 

added to the low-dimensional lattice [H]. To introduce 

with "adaptive" network structure have been investigated 

certain type of heterogeneity to this NW model [22], we 

by some researchers [19120] . 

choose Nfi vertices at random from all N nodes with equal 
In this paper, we consider evolutionary PD game on probabilities and treat them as hubs. Then we add each 
a variant of Newman- Watts (NW) small-world network, of m shortcuts by connecting one node at random from 
As is knowir, the NW small-world network is moderately all N nodes to another node randomly chosen from the 
homogeneous. In order to investigate the heterogeneity's Nh centered nodes (duplicate connections and self-links 
role in the emergence of cooperation for different tempta- are voided), see Fig. [T] as an illustration. In such heteroge- 
tions to defect, some artificial heterogeneity in network de- neous Newman- Watts (HNW) model, nodes can be nat- 
gree sequences is introduced. Namely, some nodes are ran- urally divided into two groups: hubs, which tend to have 
domly chosen as hubs and at least one endpoint of each of higher connectivity, and the others that have lower con- 
the added m shortcuts is linked to these hubs. The remain- nectivity. Accordingly, the heterogeneity is controlled by 
der of the paper is organized as follows. Section II discusses the parameter Nh : small Nh leads to higher degree of 
the heterogeneous Newman- Watts (HNW) model and the the hubs, which in turn results in increased heterogene- 
evolutionary PD game, including payoff matrix and the ity. Trivially, one could see that when Nh ~ N, shortcuts 
microscopic updating rule. And then Sec. Ill gives out are just simply added uniformly at random, effectively re- 
the simulation results for different parameters and makes ducing the network to the homogeneous Newman- Watts 
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model. If Nh = 1, all shortcuts are linked to a single cen- where the f2j: denotes the neighboring sites of x, and the 

ter, making the network an extremely heterogeneous one. sum runs over neighbor set f2x of the site x. Without loss 

The degree of heterogeneity of the network is computed as of the generic feature of PD game, the payoff matrix has 

h — N~'^ J2k k'^N{k) — (fc) (the variance of the network de- a rescaled form, suggested by Nowak and May [H] 



gree sequcence), where N{k) gives the number of vertices 

M 

with k edges, (fc) denotes the average degree. From Fig. [21 



(3) 
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it shows that variance h) monotonically decreases ^^^^^ 1< 5 < 2. In evolutionary games the players are al- 

as the fraction number of hubs Nh/N increases. Thus we j^^^^ ^^^^^ ^^^^^^^^ ^^^^^ ^^^^ successful 

simply use the fraction Nh/N to indicate the degree of neighbors. Then the individual x randomly selects a neigh- 
heterogeneity. ^^j, ^ possibly updating its strategy. Since the success 

is measured by the total payoff, whenever Py > the site 
2.2 Evolutionary Prisoner's Dilemma (PD) game x will adopt y's strategy with probability given by [TT] 

(4) 

Since the pioneering work on iterated games by Axel- '"^> 

rod [23], the evolutionary Prisoner's Dilemma (PD) game where fc> is the largest between site x's degree k^ and y's 

has been a general metaphor for studying the cooperative ky. This microscopic updating rule is some kind of imita- 

behavior. In the evolutionary PD game, the individuals tion process that is similar to Win-Stay-Lose-Shift rules in 

are pure strategists, following two simple strategies: co- spirit. Unhke the case of bounded rationality, such propor- 

operate (C) and defect (D). The spatial distribution of tional imitation (the take-over probability is proportional 

strategies is described by a two-dimensional unit vector to the payoff difference of the two sites) does not allow for 

for each player x, namely, an inferior strategy to replace a more successful one. 

3 Simulation results and discussions 

for cooperators and defectors, respectively. Each individ- Evolutionary PD game is performed analogically to repli- 

ual plays the PD game with its "neighbors" defined by cator dynamics: in each generation, all directly connected 

their who-meets-whom relationships and the incomes are pairs of individuals x and y engage in a single round game 

accumulated. The total income of the player at the site x and their accumulated payoffs are denoted by P^ and Py 

can be expressed as respectively. The synchronous updating rule is adapted 

here. Whenever a site x is updated, a neighbor y is cho- 

Px=Y^ slMsy (2) 

y^Q^ sen at random from all k^ neighbors. The chosen neighbor 
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takes over site x with probability Ws^^sy as Eq. ([4|), pro- around small Nh/N near the zero. In Fig. O we report 

vided that Py > P^. Simulations were carried out for a the result of frequency of cooperation as function of the 

population of = 2001 players occupying the vertices of parameters space {b,Nfi/N). It also shows that for fixed 

the HNW network. Initially, an equal percentage of co- b, optimum cooperation level exits at certain intermedi- 

operators and defectors was randomly distributed among ate Nh/N . In addition, for certain intermediate N^/N, 

the population. We confirm that different initial condi- the density of cooperation is higher than the cases when 

tions do not qualitatively infiuence the equilibrium results. Nh/N or Nh/N ^ 1. As a result, it reveals that op- 

In Fig. [21 with fixed chosen hub numbers Nh — 41, the timal cooperation level occurs at intermediate topological 

equilibrium frequencies of cooperators with respect to dif- heterogeneity for some fixed 6, that's neither the most het- 

ferent b are almost the same when started from different erogeneous case nor the most homogeneous one favors the 

initial conditions. Equilibrium frequencies of cooperators cooperators best. Actually, under the most homogeneous 

were obtained by average over 2000 generations after a case of Nh/N ~ 1, the cooperation behavior is almost 

transient time of 10000 generations. The evolution of the extinct for large values of b. While under the most het- 

frequency of cooperators as a function of b and Nh/N erogeneous case of Nh/N = l/N, the cooperation level 

has been computed. Furthermore, each data point results is also low. The reason for this is that, in the most het- 

from averaging over 100 simulations, corresponding to 10 erogeneous case, all shortcuts are linked to a single node, 

runs for each of 10 different realizations of a given type of making the network star-like with sparse connections be- 

network of contacts with the specified parameters. In the tween the neighbor sites of the centered node. The pe- 

foUowing simulations, N — 2001, k = 2 are kept invariant, ripheral nodes' imitation strategies heavily depend upon 

the centered individual's choice. Once the unique largest 



To investigate the influence of network degree hetero- 
geneity to the evolution of cooperation, we fixed the value 
of 6 when increased fraction of hubs Nh/N from l/N to 
1. Fig. |4] shows the equilibrium frequency of cooperators 
as function of the fraction number of hubs Nh /N by dif- 
ferent values of b for comparison when m — 1000. We find 
the PcS curve exhibits non- monotonous behavior with a 
peak at some specific value of Nh/N. As aforementioned, 
the quantity Nh/N can be regarded as a measurement 
of heterogeneity. For certain b, it has been illustrated in 
Fig. m there is a clear maximum frequency of cooperators 



hub is occupied by a defector, defection will spread over 
the entire network. Then the system can hardly recover 
from the worst case of all defectors. Therefore the most 
heterogeneous case with Nh/N = 1 is not the ideal case 
for arising cooperation. The most homogeneous case with 
Nh/N = 1 does not favor cooperation either. In this sit- 
uation, all nodes almost have the same number of neigh- 
bors with some long range shortcuts making the average 
length short. Therefore, the defection of some node is eas- 
ily spread from one node to another through the shortcuts. 
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Within some generations, the defectors prevail on the net- that increasing average degree (larger to) promotes co- 
work. Hence the most homogeneous case with Nh/N — 1 operation on the network. Nevertheless, we should point 
does not promote the evolution of cooperation. out that with sufficient large m which makes the network 

T • 1 ii r • i T X 1 i nearly fully-connected, the cooperation will be inhibited 

Let s consider the case of intermediate heterogeneity j j i t- 

, ^ . 1 r 1 1 j_ 1 1 1 due to mean-field behavior 251. On the other hand, when 

where some certain number of nodes are selected as hubs - ^ 

/ , . , r i 1 i -n ^ i\T ii\T rn changes, our above conclusion on the effect of hetero- 

(density of cooperators peaks at some specific value A'/i/ A* ^ 

c c J u\ rrr: 11 UiUT^ gcnclty to coopcration is still valid. We can see in Fig. [7] 

tor nxed o). ihese hubs are connected to each other by ^ " 

, ^ , ,1 ^, • T 1 1 1 ii that, for different fixed to and b, on still peaks at certain 

shortcuts or placed on the same ring linked by the reg- j r- 

, J rpi • -J i i- i 1 • intermediate value of NyjN . 

ular edges, ims provides the protection to each other m ' 

resisting the invasion of defectors. Even if one hub is oc- We further explore the situation where we adopt an- 

cupied by the defector, the cooperation level will tern- other microscopic update rule different from Eq. S] In 

porarily decrease due to the diffusion of defection from gtead of updating the strategies according to the accumu- 

the hub. However, other hubs occupied by cooperators lated payoff of individuals, we consider using the average 

could reciprocally help each other and promote cooper- payoff of individual x.T^^^^. Thus the new update rule 

fix 

ation behaviors on the network. Finally, cooperation is jg; 
recovered to the normal level. Accordingly, it in part re- 

suit from the ability of cooperators taking advantage of Wg^^sy — — ^^—^ — - (5) 

hubs, ft is reported in [11] that cooperation dominates in 

Barabasi- Albert (BA) scale-free network due to the de- t-, u j ^ i i ^^ ■ t^- m\ 

^ ' By such update rule, we report the results m i ig. [8j cor- 

gree heterogeneity where cooperators are more capable to , . , , , , , , i o r-t • -c j ^ 

^ ^ -J ^ J" responding to o = f.l and o = f.3. It is found that the 

occupy the hubs in the network. Though the cooperation . r r ^- ■ ^ -i- ^ 

o t- equilibrium frequency of cooperation is not sensitive to 

level on our HNW model is not as high as it on the BA i ^ at /at • r i /at ^ i /^i 

the heterogeneity as NhjN increases from f/A' to 1 (the 

scale- free network (see Fig. 151 and the figure in ref. [TT] for r „ i ^ a i\ • u 

^ ^ ' — ' curves of average payoft are almost nat). It is because 

comparison) , both of them benefit from the heterogeneity . t • ■ ^■ ■ ^ ^■> ai ^■ ■ ■ ^ ^^ ^ c 

' o ./ that normalizing individual s payoff dimmish the role of 

of the network in the evolution of cooperation. , -j^ ^ _li _li i-rr • • i- • i u 

heterogeneity. Consequently, the difference m individual s 

The average degree of HNW network (fc) = 2K+2m/N. accumulated payoff arising from the degree heterogeneity 

It is believed that average degree affects the evolution of will be positive to evolution of cooperation. We should 

cooperation. Fig.[7]plots the frequency of cooperators ver- be careful to come to a conclusion with different update 

sus Nh/N corresponding to different shortcuts number rules. Moreover, all these phenomena and conclusions are 

to = 800, 1000, 1200 respectively with b = 1.1. We find also valid under the cases for different population size TV. 
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4 Conclusion remarks and future work 

In conclusion, we have studied the effect of topological 
heterogeneity to the evolution of cooperation behavior in 
evolutionary Prisoner's Dilemma game. It is found that 
frequency of cooperation peaks at some specific value of 
Nfi/N, that is, neither the most heterogeneous case nor 
the most homogeneous one would favor cooperators. We 
found that the network degree heterogeneity is one of the 
factors affecting the emergence of cooperation. Besides, 
the average degree and the adopted update rule also play 
a role to cooperation. Therefore, it is meaningful and nec- 
essary to explore the underlying factors that do matter 
the emergence of cooperation behaviors. In addition, the 
interplay between game dynamics and network topologies 
is an interesting topic for further investigations. 
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Fig. 2 The log- log plot of the variance of network degree 
sequence versus fraction of hubs N^/N for N = 2001, m = 
1000. Each data point is averaged over 10 times different 
realization corresponding to each Nh/N . 

Fig. 3 The plot of frequencies of cooperators as function 
of temptation to defect h corresponding to the different ini- 
tial fractions of cooperators 20%, 50%, 80%, respectively. 
N = 2001, K = 2, TO = 1000, Nh = 41. 

Fig. 4 Frequency of cooperators as function of the frac- 
tion of hubs Nh/N, for different values of the temptation 
to defect b as shown in the legend. Note that when 6=1, 
the game is not a proper PD game. 

Fig. 5 The frequency of cooperators Pc as function of 
the parameter space {b,Nh/N). The red region indicates 
the cooperation of high level corresponding to the inter- 
mediate Nh and b. 
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Fig.l Illustration of the heterogeneous Newman- Watts 
small-world model. A one-dimensional lattice with con- 
nections between all vertex pairs separated by k or fewer 
lattice spacing, with k = 2 in this case. The red dots are 
chosen as centers or hubs and the added m shortcuts (the 
dashed line) have at least one endpoint belonging to these 
hubs. 
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Fig. 6 The frequencies of cooperators pc vs. the temp- 
tation to defect b with different levels of heterogeneity. 

Fig. 7 Plot of the fraction of cooperators vs. Nh/N for 
different values of m with b = 1.1. 

Fig. 8 Plot of the results with update rules correspond- 
ing to average and accumulated payoff respectively. Fig.[8]- 
A plots the case when 6=1.1 and Fig. [8]-B with 6 = 1.3 
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Fig. 6. 



